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ABSTRACT 


This  I  paper  deals  with  an  optimization  technique  applied  to  natural  texture  syn¬ 
thesis.  Vye  propose^  definition  of  a  global  criterion  which  is  the  mean  square  error 
between  the  statistical  features  of  a  natural  original  texture  and  those  of  an  artificially 
generated  one.  A  gradient  r’^orithm  is  used  to  minimize  this  criterion.  The  statistical 
feature  vector  used  was  the  autocorrelation  function  although  this  is  by  no  means  the 
only  choice.  The  textures  generated  are  very  similar  to  the  original  ones.  This  method 
can  be  implemented  in  a  highly  parallel  manner. 
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I.  Introduction 


Texture  synthesis  is  eery  important  for  the  image  reconstruction  of  natural  scenes  from 
compressed  data.  It  can  be  applied  to  the  generation  of  artificial  images  need  in  ,  for  example, 
flight  simulators  or  cinematic  effects.  As  shown  in  earlier  papers  |1,2|,  second  order  statistics  are 
the  important  features  to  describe  the  stochastical  texture  field  with  respect  to  the  human 
observer.  Some  methods  have  been  proposed  for  the  synthesis  of  textures  horn  their  a  priori  given 
second  order  statistics  (3,4] .  The  drawbacks  of  these  methods  are  as  follows: 

1)  In  some  of  these  methods,  higher  order  statistics  have  to  be  invented  which  requires  a 
memory  far  beyond  the  capabilities  of  any  computer,  especially  in  the  case  of  natural  texture  syn¬ 
thesis. 

2)  Some  other  methods  utilise  autoregressive  models  which  only  allows  control  of  the  auto¬ 
correlation  function  which  is  often  not  sufficient  to  describe  a  texture  .  The  stability  of  such  two 
dimensional  filters  is  also  a  very  difficult  problem. 

In  our  two  previous  papers(5,6],  we  have  presented  a  new  method  for  natural  texture  syn¬ 
thesis.  By  this  method,  without  having  to  invent  higher  order  statistics,  we  can  generate  textures 
by  controlling  their  second  order  statistics  (second  order  spatial  averages  or  histogram  plus  auto¬ 
correlation  function).  The  results  showed  that  the  generated  textures  are  very  similar  visually  to 
the  natural  textures  they  are  intended  to  approximate.  However, this  was  a  ttquential  method 
which  needs  a  long  computation  time  and  this  can  be  an  important  drawback  for  practical  appli¬ 
cation. 

In  this  paper,  we  will  present  a  parallel  method  of  texture  synthesis  based  upon  an  optimiza¬ 
tion  technique.  Using  a  gradient  algorithm,  we  minimize  a  global  criterion  which  is  the  mean 

square  error  between  the  feature  vector  of  the  generated  texture  and  that  of  a  given  reference 
natural  texture.  The  parameters  of  the  feature  vector  could  be  the  second  order  spatial  momenta 

of  the  texture  or  any  other  higher  order  spatial  momenta  if  necessary. 


2.  Feature  vector  of  a  texture  field 


A  liven  texture  can  be  considered  as  a  realization  of  a  stochastic  process.  This  is  defined  on 
a  rectangular  discrete  plane  and  takes  its  value  in  the  interval  [0  ,  i|. 

Since  the  discrete  plane  can  be  ordered,  a  point  of  this  plane  will  be  represented  by  its  rank 
i.  In  what  follows,  a  given  texture  will  be  represented  by  a  one  dimensional  vector  X: 

(  *1  »  *2 . *« . ) 

where  N  is  the  total  number  of  points  in  the  plane  and  x,  represents  the  value  of  the  stochastic 
process  at  location  i  (or  the  grey  level  value  of  the  texture  field  in  the  spatial  position  i). 

We  define  a  set  of  translations  TA : 

la  "  (  » ••••  ) 

where  each  element  is  a  displacement  vector  between  two  points  ,  one  being  the  center  of  a 
window, and  the  other  one  of  the  points  of  this  window  (see  Figure  1).  The  autocovariance 
coefficients  associated  with  each  translation  A*  are  defined  by 

•a,  "  ~  ^  A*  TA  (1) 

where  if  and  a  are  the  mean  am!  variance  of  the  image: 

1  -  (2) 

o-jfh’r’tr  (3) 

We  define  a  one-dimensional  feature  vector  B  composed  of  all  the  statistical  parameters 
that  we  want  to  control  in  the  synthesis  procedure.  In  what  follows,  it  will  be  composed  of  all  the 
autocovariance  parameters  corresponding  to  the  translation  set  T* 

We  will  denote  by  B77,  rjTX,  <rTX  the  feature  vector, the  autocovariance  parameters,  the 
mews  and  the  variance  of  the  generated  texture,  and  B,  e^,  9,  a  will  be  the  ierirti  feature  vec- 
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tor,  the  antocovariance  parameters,  the  mean  and  the  rarianc.  which  ^  c«m  from  the 
•ataral  original  texture  we  want  to  approximate.  Thea  we  hare: 


>  *4j  »  •••»  *i|  ) 


nf*_  /  .tx  „nr  rx  \ 


3.  Synthesis  procedure 


A  global  criterion  is  proposed: 

C*X)  -  II  b~btx  II*  +  »I(H  -  n"f  +  (4) 

The  first  term  C(X)  is  the  mean  square  error  of  the  feature  vector.  The  second  and  third  terms  are 
the  constraints  of  the  mean  and  variance  of  the  texture  image,  where  wl  and  w2  are  very  large 
numbers. 

Our  synthesis  procedure  is  :  from  an  initial  value  A°,  which  is  white  noise  having  the  desired 
mean  and  variance,  we  use  an  iterative  algorithm  (called  a  gradient  algorithm)  to  minimise  the 
global  criterion  C(X)  defined  previously.  In  the  ntt  iteration  of  the  algorithm 

A-«- 

where  G*  is  the  criterion’s  gradient  at  point  A*  and  pa  is  a  positive  number. 

From  (1-4),  we  can  calculate  <7* : 

G"~(GJ,G2,  •••  GT,  •••  crs)T 

°r  —  iC^-  —  S*  —  g  —  (  -  V  )  +  wl(  n-r>TX)  +  2w2(<r  -  <rrx)( x,  -  ij)  ,i-l  -  N 

•  4 

C  can  be  calculated  in  a  ptrallel  manner. 

p*  is  a  positive  numbet  chosen  so  that  it  minimises  C(X)  with  the  ccadition  that  z,  (i*-l,N) 
lies  inside  the  inter -t.  *0,1].  This  condition  gives  us  a  largest  positive  value  Puax  '■ 


if  G?>0 
if  Gf<0 
if  CT«0 


*,7  cr 

00 

For  simplicity,  we  take  p*  ■  Puax  »  although  this  is  not  optimal.  Farther  explanation  of 
this  gradient  algorithm  can  be  found  in  (7]. 


4.  Results 


This  parallel  algorithm  proposed  has  been  simulated  sequentially  by  computer.  Pour 
different  types  of  textures  have  been  synthesised  (SAND,  SEISMIC  PICTURE,  RATTAN  and 
WOOL).  SAND  and  SEISMIC  PICTURE  have  been  synthesized  by  controlling  their  autocovari- 
ance  parameters  in  a  0*9  window  (see  Figure  1).  In  the  case  of  RATTAN  and  WOOL,  it  was  a 
25*25  window.  This  size  is  related  to  the  size  of  the  basic  pattern  of  each  texture. 

Practically,  we  have  verified  that  5  -  10  iterations  were  sufficient  to  obtain  good  approxima¬ 
tions  of  the  original  natural  textures.  Table  1  shows  the  evolution  of  the  criterion  at  each  itera¬ 
tion.  C0  is  the  initial  value  of  the  criterion.  The  initial  synthesized  texture  is  white  noise  having 
the  same  histogram  as  the  corresponding  natural  texture,  so  the  mean  and  the  variance  of  this 
white  noise  are  already  equal  to  the  desired  values  which  makes  the  convergence  more  rapid.  Fig¬ 
ure  2  shows  the  synthesized  textures  approximating  SEISMIC  PICTURE  after  1  to  8  iterations. 
Figure  2  is  composed  of  two  512*512  pictures,  each  being  divided  into  four  256*256  pictures 
corresponding  to  the  various  iterations. 

Figures  4,5,6  and  7  are  presented  hi  the  format  shown  in  Figure  3.  They  show  the  results  of 
the  parallel  synthesis  of  SEISMIC  PICTURE,  SAND,  RATTAN  rad  WOOL,  respectively,  after  8 
iterations  and  their  comparison  with  the  original  natural  textures  from  which  the  feature  vectors 
were  computed.  The  reader  can  verify  that  the  synthesized  textures  are  very  similar  visually  to 
the  original  ones. 

This  method  gives  us  a  way  to  synthesise  artificial  textures  in  a  parallel  manner  from  a 
compressed  set  of  data  with  a  good  visual  similarity  to  natural  textures.  We  think  that  such  a 
technique  could  be  applied  effectively  for  the  generation  of  synthetic  images  in  flight  simulators  or 
for  computer  generated  movie  films  if  a  parallel  computer  were  available. 
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Figure  1  :  A  translation  set  TA 


Figure  2  :  SEISMIC  PICTURE  synthesis,  results  after  1  to  8  iterations 


Figure  5  :  SAND  synthesis: 

a)  natural  SAND  b)  generated  texture 


Figure  6  :  RATTAN  synthesis: 

a)  natural  RATTAN  b)  generated  texture 


Figure  7  :  WOOL  synthesis: 


a)  natural  WOOL  b)  generated  texture 
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Table  1  :  Evolution  of  the  criterion  C(X) 
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